Design and Position Control of a Bionic Joint Actuated by Shape Memory Alloy Wires.

Bionic joints are crucial for robotic motion and are a hot topic in robotics research. Among various actuators for joints, shape memory alloys (SMAs) have attracted significant interest due to their similarity to natural muscles. SMA exhibits the shape memory effect (SME) based on martensite-to-austenite transformation and its inverse, which allows for force and displacement output through low-voltage heating. However, one of the main challenges with SMA is its limited axial stroke. In this article, a bionic joint based on SMA wires and a differential pulley set structure was proposed. The axial stroke of the SMA wires was converted into rotational motion by the stroke amplification of the differential pulley set, enabling the joint to rotate by a sufficient angle. We modeled the bionic joint and designed a proportional-integral (PI) controller. We demonstrated that the bionic joint exhibited good position control performance, achieving a rotation angle range of -30° to 30°. The proposed bionic joint, utilizing SMA wires and a differential pulley set, offers an innovative solution for enhancing the range of motion in SMA actuated bionic joints.

Design and Force/Angle Independent Control of a Bionic Mechanical Ankle Based on an Artificial Muscle Matrix.

Inspired by the natural skeletal muscles, this paper presents a novel shape memory alloy-based artificial muscle matrix (AMM) with advantages of a large output force and displacement, flexibility, and compactness. According to the composition of the AMM, we propose a matrix control strategy to achieve independent control of the output force and displacement of the AMM. Based on the kinematics simulation and experiments, we obtained the output displacement and bearing capacity of the smart digital structure (SDS) and confirmed the effectiveness of the matrix control strategy to achieve force and displacement output independently and controllably. A bionic mechanical ankle actuated by AMM was proposed to demonstrate the actuating capability of the AMM. Experimental results show that the angle and force of the bionic mechanical ankle are output independently and have a significant gradient. In addition, by using a self-sensing method (resistance self-feedback) and PD control strategy, the output angle and force of the bionic mechanical ankle can be maintained for a long time without overheating of the AMM.

Inverse Origami Design Model for Soft Robotic Development.

Origami provides an opportunity to construct a wide range of 3D functional structures by folding a flat sheet. It can be used to develop various soft functional robots by combining soft smart actuators. However, a simple and an effective model that can address the challenging problem of designing origami patterns to connect origami design with robotics is lacking, thereby greatly increasing the threshold of soft origami robots and hindering its development. This study proposes an easy-to-use inverse origami design model to generate the flat crease pattern from the desired folded shape automatically while simulating origami morphing by simply providing the shape parameters or 2D shape graphics. This method overcomes the difficulty of origami design and enables a close connection between origami and robotics. Through this method, various soft origami robots can be developed with low design complexity and time cost to achieve different functions, thereby promoting the development of soft origami robots.

Design, Modeling, and Control of an Aurelia-Inspired Robot Based on SMA Artificial Muscles.

This paper presented a flexible and easily fabricated untethered underwater robot inspired by Aurelia, which is named "Au-robot". The Au-robot is actuated by six radial fins made of shape memory alloy (SMA) artificial muscle modules, which can realize pulse jet propulsion motion. The thrust model of the Au-robot's underwater motion is developed and analyzed. To achieve a multimodal and smooth swimming transition for the Au-robot, a control method integrating a central pattern generator (CPG) and an adaptive regulation (AR) heating strategy is provided. The experimental results demonstrate that the Au-robot, with good bionic properties in structure and movement mode, can achieve a smooth transition from low-frequency swimming to high-frequency swimming with an average maximum instantaneous velocity of 12.61 cm/s. It shows that a robot designed and fabricated with artificial muscle can imitate biological structures and movement traits more realistically and has better motor performance.

Accurate instance segmentation of surgical instruments in robotic surgery: model refinement and cross-dataset evaluation.

PURPOSE: Automatic segmentation of surgical instruments in robot-assisted minimally invasive surgery plays a fundamental role in improving context awareness. In this work, we present an instance segmentation model based on refined Mask R-CNN for accurately segmenting the instruments as well as identifying their types. METHODS: We re-formulate the instrument segmentation task as an instance segmentation task. Then we optimize the Mask R-CNN with anchor optimization and improved Region Proposal Network for instrument segmentation. Moreover, we perform cross-dataset evaluation with different sampling strategies. RESULTS: We evaluate our model on a public dataset of the MICCAI 2017 Endoscopic Vision Challenge with two segmentation tasks, and both achieve new state-of-the-art performance. Besides, cross-dataset training improved the performance on both segmentation tasks compared with those tested on the public dataset. CONCLUSION: Results demonstrate the effectiveness of the proposed instance segmentation network for surgical instruments segmentation. Cross-dataset evaluation shows our instance segmentation model presents certain cross-dataset generalization capability, and cross-dataset training can significantly improve the segmentation performance. Our empirical study also provides guidance on how to allocate the annotation cost for surgeons while labelling a new dataset in practice.

Multimodal 3D Printing of Phantoms to Simulate Biological Tissue.

Biomedical optical imaging is playing an important role in diagnosis and treatment of various diseases. However, the accuracy and the reproducibility of an optical imaging device are greatly affected by the performance characteristics of its components, the test environment, and the operations. Therefore, it is necessary to calibrate these devices by traceable phantom standards. However, most of the currently available phantoms are homogeneous phantoms that cannot simulate multimodal and dynamic characteristics of biological tissue. Here, we show the fabrication of heterogeneous tissue-simulating phantoms using a production line integrating a spin coating module, a polyjet module, a fused deposition modeling (FDM) module, and an automatic control framework. The structural information and the optical parameters of a "digital optical phantom" are defined in a prototype file, imported to the production line, and fabricated layer-by-layer with sequential switch between different printing modalities. Technical capability of such a production line is exemplified by the automatic printing of skin-simulating phantoms that comprise the epidermis, dermis, subcutaneous tissue, and an embedded tumor.

A new robotic tactile sensor with bio-mimetic structural colour inspired by Morpho butterflies.

Since tactile perception and robotic manipulation play important roles in human survival, we propose a new method for developing robotic tactile sensors based on the structural colours of Morpho menelaus (a kind of Morpho butterfly). The first task is to fabricate a flexible bioinspired grating with a similar microstructure to the wings of Morpho menelaus using the transfer technique, onto the surfaces of polydimethylsiloxane (PDMS) films. The second task, depending on the angle of diffracted light, is to integrate the flexible diffraction grating with a polychromatic light source and a CCD camera, and then predict the position and magnitude of the contact force caused by a change in the diffraction pattern. The final task is to set up an experimental calibration platform and a marker point array with an interval of 1 mm for an image processing algorithm and a deep learning method to establish the relationship between the contact point position, and the magnitude of the force and diffraction pattern. The results showed that this tactile sensor has high sensitivity and resolution, with the position of the contact force of 1 mm. This practical application of the UR-5 manipulator verifies the feasibility of the prototype as a tactile sensor. This tactile sensing method may be widely used in robotics by miniaturising the design.

Simulating orientation and polarization characteristics of dense fibrous tissue by electrostatic spinning of polymeric fibers.

Phantoms simulating polarization characteristics of soft tissue play an important role in the development, calibration, and validation of diagnostic polarized imaging devices and of therapeutic strategy, in both laboratory and clinical settings. We propose to fabricate optical phantoms that simulate polarization characteristics of dense fibrous tissues by bonding electrospun polylactic acid (PLA) fibers between polydimethylsiloxane (PDMS) substrate with a groove. Increasing the rotational speed of an electrospinning collector helps improve the orientation of the electrospun fibers. The phantoms simulate the polarization characteristics of dense fibrous tissue of collagenous fibroma and healthy skin with high fidelity. Our experiments demonstrate the technical potential of using such phantoms for validation and calibration of polarimetric medical devices.

Fabrication of a multilayer tissue-mimicking phantom with tunable optical properties to simulate vascular oxygenation and perfusion for optical imaging technology.

Vast research has been carried out to fabricate tissue-mimicking phantoms, due to their convenient use and ease of storage, to assess and validate the performance of optical imaging devices. However, to the best of our knowledge, there has been little research on the use of multilayer tissue phantoms for optical imaging technology, although their structure is closer to that of real skin tissue. In this work, we design, fabricate, and characterize multilayer tissue-mimicking phantoms, with a morphological mouse ear blood vessel, that contain an epidermis, a dermis, and a hypodermis. Each tissue-mimicking phantom layer is characterized individually to match specific skin tissue layer characteristics. The thickness, optical properties (absorption coefficient and reduced scattering coefficient), oxygenation, and perfusion of skin are the most critical parameters for disease diagnosis and for some medical equipment. These phantoms can be used as calibration artifacts and help to evaluate optical imaging technologies.

Design of a portable phantom device to simulate tissue oxygenation and blood perfusion.

We propose a portable phantom system for calibration and validation of medical optical devices in a clinical setting. The phantom system comprises a perfusion module and an exchangeable tissue-simulating phantom that simulates tissue oxygenation and blood perfusion. The perfusion module consists of a peristaltic pump, two liquid storage units, and two pressure suppressors. The tissue-simulating phantom is fabricated by a three-dimensional (3D) printing process with microchannels embedded to simulate blood vessels. Optical scattering and absorption properties of biologic tissue are simulated by mixing graphite powder and titanium dioxide powder with clear photoreactive resin at specific ratios. Tissue oxygen saturation (StO2) and blood perfusion are simulated by circulating the mixture of blood and intralipid at different oxygenation levels and flow rates. A house-made multimodal imaging system that combines multispectral imaging and laser speckle imaging are used for non-invasive detection of phantom oxygenation and perfusion, and the measurements are compared with those of a commercial Moor device as well as numerical simulation. By acquiring multimodal imaging data from one phantom and applying the calibration factors in different settings, we demonstrate the technical feasibility to calibrate optical devices for consistent measurements. By simulating retina tissue vasculature and acquiring functional images at different tissue oxygenation and blood perfusion levels, we demonstrate the clinical potential to simulate tissue anomalies. Our experiments imply the clinical potential of a portable, low-cost, and traceable phantom standard to calibrate and validate medical optical devices for improved performance.

Freeform fabrication of tissue-simulating phantom for potential use of surgical planning in conjoined twins separation surgery.

Preoperative assessment of tissue anatomy and accurate surgical planning is crucial in conjoined twin separation surgery. We developed a new method that combines three-dimensional (3D) printing, assembling, and casting to produce anatomic models of high fidelity for surgical planning. The related anatomic features of the conjoined twins were captured by computed tomography (CT), classified as five organ groups, and reconstructed as five computer models. Among these organ groups, the skeleton was produced by fused deposition modeling (FDM) using acrylonitrile-butadiene-styrene. For the other four organ groups, shell molds were prepared by FDM and cast with silica gel to simulate soft tissues, with contrast enhancement pigments added to simulate different CT and visual contrasts. The produced models were assembled, positioned firmly within a 3D printed shell mold simulating the skin boundary, and cast with transparent silica gel. The produced phantom was subject to further CT scan in comparison with that of the patient data for fidelity evaluation. Further data analysis showed that the produced model reassembled the geometric features of the original CT data with an overall mean deviation of less than 2 mm, indicating the clinical potential to use this method for surgical planning in conjoined twin separation surgery.

A starfish robot based on soft and smart modular structure (SMS) actuated by SMA wires.

This paper describes the design, fabrication and locomotion of a starfish robot whose locomotion principle is derived from a starfish. The starfish robot has a number of tentacles or arms extending from its central body in the form of a disk, like the topology of a real starfish. The arm, which is a soft and composite structure (which we call the smart modular structure (SMS)) generating a planar reciprocal motion with a high speed of response upon the actuation provided by the shape memory alloy (SMA) wires, is fabricated from soft and smart materials. Based on the variation in the resistance of the SMA wires during their heating, an adaptive regulation (AR) heating strategy is proposed to (i) avoid overheating of the SMA wires, (ii) provide bending range control and (iii) achieve a high speed of response favorable to successfully propelling the starfish robot. Using a finite-segment method, a thermal dynamic model of the SMS is established to describe its thermal behavior under the AR and a constant heating strategy. A starfish robot with five SMS tentacles was tested with different control parameters to optimize its locomotion speed. As demonstrated in the accompanying video file, the robot successfully propelled in semi-submerged and underwater environments show its locomotion ability in the multi-media, like a real starfish. The propulsion speed of the starfish robot is at least an order of magnitude higher than that of those reported in the literature-thanks to the SMS controlled with the AR strategy.

Three-dimensional fuse deposition modeling of tissue-simulating phantom for biomedical optical imaging.

Biomedical optical devices are widely used for clinical detection of various tissue anomalies. However, optical measurements have limited accuracy and traceability, partially owing to the lack of effective calibration methods that simulate the actual tissue conditions. To facilitate standardized calibration and performance evaluation of medical optical devices, we develop a three-dimensional fuse deposition modeling (FDM) technique for freeform fabrication of tissue-simulating phantoms. The FDM system uses transparent gel wax as the base material, titanium dioxide (TiO2 ) powder as the scattering ingredient, and graphite powder as the absorption ingredient. The ingredients are preheated, mixed, and deposited at the designated ratios layer-by-layer to simulate tissue structural and optical heterogeneities. By printing the sections of human brain model based on magnetic resonance images, we demonstrate the capability for simulating tissue structural heterogeneities. By measuring optical properties of multilayered phantoms and comparing with numerical simulation, we demonstrate the feasibility for simulating tissue optical properties. By creating a rat head phantom with embedded vasculature, we demonstrate the potential for mimicking physiologic processes of a living system.

Microfabrication of polydimethylsiloxane phantoms to simulate tumor hypoxia and vascular anomaly.

We introduce a microfluidic approach to simulate tumor hypoxia and vascular anomaly. Polydimethylsiloxane (PDMS) phantoms with embedded microchannel networks were fabricated by a soft lithography process. A dialysis membrane was sandwiched between two PDMS slabs to simulate the controlled mass transport and oxygen metabolism. A tortuous microchannel network was fabricated to simulate tumor microvasculature. A dual-modal multispectral and laser speckle imaging system was used for oxygen and blood flow imaging in the tumor-simulating phantom. The imaging results were compared with those of the normal vasculature. Our experiments demonstrated the technical feasibility of simulating tumor hypoxia and vascular anomalies using the proposed PDMS phantom. Such a phantom fabrication technique may be potentially used to calibrate optical imaging devices, to study the mechanisms for tumor hypoxia and angiogenesis, and to optimize the drug delivery strategies.